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TESTING AND EVALUATION 



























This second conference is designed 
to focus attention on new ideas, 
research and development in the 
techniques of testing and 
evaluating electronic information 
handling systems. 


SECOND CONFERENCE ON 


The conference will feature a review 
of the “state-of-the-art” covering the 
development of criteria and measures 
for evaluation. Such a review is 
expected to benefit organizations 
which are investing heavily in the 
development of operational systems. 


TESTING 


AND EVALUATION 


APRIL 12, 13 AND 14, 1967 


Since facilities are limited, the 
attached registration form for the 
conference and hotel accommodations 
should be filled out and returned as 
soon as possible. If it becomes 
necessary to limit attendance before 
the conference opening, those who 
include registration fees with their 
reservations will be 
given priority. 


Flying Carpet Motor Lodge 
near Greater Pittsburgh Airport ) 
Pittsburgh, Pennsylvania 


CO-SPONSORED BY 

University of Pittsburgh • 
Western Michigan University • 
Office of Naval Research • 
Goodyear Aerospace Corporation • 
The Association for • 
Computing Machinery ( SIGIR ) 


Printed copies of the proceedings 
are expected to be available shortly 
after the conference. 




--- 
















CONFERENCE ON ELECTRONIC HANDLING II 
TESTING AND EVALUATION 
PITTSBURGH, PENNSYLVANIA 
APRIL 12-14, 1967 

PROGRAM 

APRIL 12, 1967 
2-5:30 P.M. 

Welcome 

DAVID KURTZMAN, 

Chancellor, University of Pittsburgh 

Introduction 

Chairman: orrin e. taulbee, University of Pittsburgh 

Experimenting and Evaluation: The Challenge 
ruth davis, Department of Defense 

Needs in the Health Sciences 

m. cummings, National Library of Medicine 

Centralization, Decentralization and Specialization: 

A Problem in Resource Allocation 
allen kent, University of Pittsburgh 

A Statistician s Comment 

john tukey, Princeton University 


APRIL 13, 

2-5:00 P.M. 

Document Handling—Research in Progress 
(Chairman: j. belzer, University of Pittsburgh) 

Indexing Depth, Retrieval Effectiveness 
and Time-Sharing 

•b. f. cheydleur, Ford Motor Company 

Modeling in Document Handling 

e. bryant, Westat Inc. 

Relevance Predictability 

E. DYM, d. shirey, m. kurfeerst 

University of Pittsburgh 

Problems in the Evaluation of a Large 
Operational Retrieval System 

f. w. Lancaster, National Library of Medicine 

APRIL 13 

8:30 P.M. 

Banquet Address 

The Library—A Man-Machine System 
l. e. saline, General Learning Corporation 


APRIL 12 

8:30 P.M. 

Panel on Man-Machine-Information Interaction 
(Chairman: jules mersel) 

(Panelists: m. h. gotterer, a. tauber) 

APRIL 13, 1967 

9-12:00 NOON 

Information Handling—Review 

(Chairman: A. kent, University of Pittsburgh) 

Testing and Evaluation—Literature Review 
s. treu, Goodyear Aerospace Corporation 

Machine Aided Translation and Information Retrieval 
richard see, National Science Foundation 

Intelligence Systems 

david mccarn, Defense Intelligence Agency 

Principles of Biological Computations 
HEINZ VON foerster, University of Illinois 



APRIL 14, 1967 

9-12:00 NOON 

Document Handling—Research in Progress 
(Chairman: G. mallinson, Western Michigan 
University) 

An Approach to Comprehensive Evaluation 
orrin e. taulbee, University of Pittsburgh 

Measures and Criteria for Evaluation 

j. t. welch, jr. Goodyear Aerospace Corporation 

A System Performance Function 
a. bednarek, University of Florida and 
j. belzer, University of Pittsburgh 

Behavioral Aspects of Testing and Evaluation 
monroe B. snyder, Human Science Research, Inc. 

Luncheon Address—The Status of 
Information Systems in Europe 
B. C. VICKERY, ASLIB 







APRIL 14 

2-5:00 P.M. 

Hindsight, Foresight, Oversight on Information Systems 
(Chairman: g. goldstein, Office of Naval Research) 

An Inter-University Information Network 
GEORGE BROWN, U.C.L.A. 

Command and Control as a 
Management Information System 
marshall yovits, Ohio State University 

Analyzing Time-Sharing Systems * 

jules schwartz, System Development Corporation A 

Conclusions on Evaluation and 9 

Evaluation of Conclusions 

RICHARD WILCOX, Office of Naval Research 

REGISTRATION INFORMATION 

CONFERENCE ON ELECTRONIC 
INFORMATION HANDLING 
Flying Carpet Motor Lodge 
{near Greater Pittsburgh Airport ) 

APRIL 12 - 14 , 1967 

The registration fee of $ 25.00 covers all sessions 
—the Thursday evening social hour and banquet, 
the Friday noon luncheon, and morning and 
afternoon coffee breaks each day. Because casual 
dining facilities are limited, a Thursday luncheon 
has also been organized for the convenience of 
those attending the conference. The cost of this 
luncheon (optional) is $ 4 . 50 , and should be added 
to the registration fee if participation is desired. 

Pre-registration for both the conference and for 
housing is strongly recommended, since attendance 
will be limited by available facilities. 

Confirmation for housing will come directly 
from the Motor Lodge 

(Free 24 -hour shuttle service between Greater 
Pittsburgh Airport and the Motor Lodges will 
be provided). 

Weather permitting, the Motor Lodge will have 
its outdoor heated swimming pool available. 
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